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Abstract: Let h be a without fixed point lift to the plane of a homeomorphism of 
the open annulus isotopic to the identity and without wandering point. We show that h 
admits a /i-invariant dense open set O on which it is conjugate to a translation and we 
study the action of h on the compactly connected components of the closed and without 
interior set R 2 \ O. 



0. Introduction. 

0.1. In the paper [BCL] the authors consider homeomorphisms H of the open an- 
nulus 5" 1 x R isotopic to the identity and preserving the Lebesgue measure. Given such 
a homeomorphism and a lift h : R 2 — > R 2 to the universal cover they show (in their 
proposition 3.1) that if the closure of the rotation set of h is contained in ]0, +oo[, then h 
is conjugate to a translation. (Here the rotation set refers to a definition, adapted to this 
non compact situation, proposed by Le Calvez [LC] and using only recurrent points of H 
in its construction). 

They remark that this statement is sharp, and give an example of a measure preserving 
homeomorphism H of S 1 x R isotopic to the identity, such that, for some lift h of H, the 
rotation set of h is included in ]0, +oo[, but h is not conjugate to a translation (see 0.2 
below) . 

In the present note we wish to investigate the structure of such homeomorphims. 
More generally, we will consider a homeomorphism H of the annulus S 1 x R isotopic to 
the identity, without wandering point which admits a lift h to R 2 without fixed point. We 
will show that some of the features of example 0.2 are indeed preserved in that general 
situation. 

We will prove: 

A) There exists an h-invariant dense open set homeomorphic to R 2 , O C R 2 , such that h 
restricted to O is conjugate to a translation. (See paragraph 1). 

B) Let W = R 2 \ O which is a closed subset with no interior in R 2 . We have: 

- Bl) No closed compactly connected component (cf. 2.1 below) of W is invariant 
under h. (Cf. Prop. 2.5). 
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- B2) We now assume that the compactly connected components ofW are closed (or 
equivalently that the connected components ofW are compactly connected). Then for every 
such component C, if X = liminf h n (C), 

either X is empty (that is h n (C) — > oo, meaning that, for every compact K C R 2 
there exists an integer n(K) such that h n (C) P| K = for n > n(K) ) 

or it is not empty and no point of X is accessible from R 2 \ [J neZ h n (C). (Cf. Prop. 
2.12). 

0.2. The Le Roux example [BCL, Appendix A]: 

We will describe the lift h of this example to R 2 . Let Ik be the vertical segment 
i(^y)\y > \k\} and Abe U fee z\{o} h and let W = [j neZ T n (A) where T(x,y) = (x + 
l,y). Then R 2 \ W is homeomorphic to R 2 and can be foliated by lines equivariantely 
with respect to T. The homeomorphism h is choosen to act equivariantely, without fixed 
point, preserving each line of the foliation and satisfying h(Ik) = Ik-i f° r fc ^ 0, 1. On 
each leaf of the foliation, h is equivariantly conjugate to a translation hence h preserves 
a measure without atoms and charging the open sets. On 5" 1 x R seen as S 2 minus the 
two poles, H preserves such a measure which is finite. That measure is nothing but the 
Lebesgue measure up to conjugation thanks to a classical result of Oxtoby and Ulam. 

To see that h is not conjugate to a translation notice that the compact segment going 
from xq = (— 1) to its translate T(xo) = (^, 1) has to meet all its images by all iterates 
of h since W is /i-invariant. 

We owe to P. Le Calvez the remark that this example can also be described without 
any reference to the Oxtoby-Ulam theorem. Consider the part of the phase space (which 
is homeomorphic to S 1 x R) of the free undamped pedulum above the upper separatrix: 
it is homeomorphic to S 1 x [0, +oo[. We now focus on the time 1 of the corresponding 
autonomous hamiltonian and on an orbit of this diffeomorphism on the separatrix. Folding 
each complementary interval of this orbit on the separatrix and identifying all points of 
the orbit and the equilibrium point of the separatrix to a single point, we get an example 
conjugate to the preceding one after deleting that single point. 

Acknowledgement. Some arguments of this paper can be traced back to an old article 
of T. Homma and H. Kinoshita [HK], which makes for a hard reading but a rewarding one. 
Many thanks to Patrice Le Calvez for a careful reading of a first version of this paper. 



1. Brouwer homeomorphisms. 

Homeomorphisms of the plane preserving orientation and without fixed point are 
called Brouwer homeomorphisms (see [Gl] for more on these). These homeomorphisms 
have only wandering points and more generally satisfy the following particular version of 
Franks' lemma (in a reformulation due to Le Roux [LR1, Lemma 7]). Recall first that a 
subset A of R 2 is free if h(A) f| A = 0. 
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1.1 Lemma. Let U and V be two free connected open sets. Then the subset of integers 
such that h n (U) f)V ^ is an interval ofZ. 

Proof: The usual formulation of this lemma concerns the case where U and V are 
open discs. To prove the present lemma from this case, suppose there exists k < n < m 
such that h k (U) f| V ^ 0, h n (U) f| V = and h m (U) f| V ^ 0. Let m e *7 such that vi = 
h k (ui) G y and u 2 E U such that ^2 = h m (u2) £ and let .D and -D' be discs in U and V 
respectively such that u u u 2 E D and v 1 ,v 2 eD'. Then /i fc (D) f| D' ^ 0, h n (D) f| £>' = 
and h m (D) f]D' ^ in contradiction to Franks' lemma. 

A Brouwer line for a Brouwer homeomorphism h is a properly embedded free line I 
such that / separates /i _1 (/) and h(l).We will start with the following result from [G2] . 

1.2 Theorem. Let H : S 1 x R — > 5 1 x R be a homeomorphism isotopic to the identity 
such that : 

- H admits a fixed point free lift h : R 2 — > R 2 . 

- does not /iai> e any wandering point. 

Then there exists a properly embedded line in S 1 x R joining one end of the annulus 
to the other which lifts in R 2 to a Brouwer line. 

Notice that such a Brouwer line projects properly and onto on {0} x R (and also, a 
properly embedded line in R 2 which projects properly and onto on {0} x R is a Brouwer 
line if it is free, that is, the requirement that / separates and h(l) is automatically 

satisfied) . 

Given any Brouwer line /, if we let U be the open region between / and h(l), then the 
set O = Unez h n (C\U) is homeomorphic to R 2 and the restriction of h to O is conjugate 
to a translation.Therefore to prove statement A of the introduction, it is enough to prove 
that if the Brouwer homeomorphism h is a lift of a homeomorphism H of the open annulus 
without wandering point, then R 2 \ O has no interior for a convenient choice of Brouwer 
line /. To this end, we choose a Brouwer line / as given by Theorem 1.2 that we orient 
so that / induces by projection the usual orientation on {0} x R. The following Lemma 
is then enough to conclude the proof of statement A (this lemma is an extension of the 
lemma in Winkelnkemper [W]). 

1.3 Lemma. Let B n (resp. B' n ) be the component of R 2 \ h n (l) to the right (resp. to the 
left) ofh n (l). Then the closed h-invariant set W = C\t=-oo B n fresp. W = f)n=-oo B n) 
has no interior. 

Proof. Exchanging h and h~ x if necessary, we can suppose h{l) on the right of 
Suppose U C W is an open subset which we can choose small enough to be free and 
projecting homeomorphically on S 1 x R; since U C W, h~ n (U) lies on the right of / for all 
n > 0. Given the properties of I, there is a m > such that U lies on the left of T m (/), then 
h~ n (U) lies on the left of /i" n (T m (/)) = T m (/i" n (/)) which is on the left of T m (/) for n > 0. 
So that all h~ n (U), n > 0, lie on the left of T m (l) and on the right of /. There are only a 
finite number of translates of U between / and T m (/), say U = Ui, U2, ■ ■ ■ , Uu and each one 
is wandering. Since H has no wandering point on 5" 1 x R, there exists n\ > such that 
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h~ ni (Ui) meets some U i: say Uj^y Let V\ = h~ ni (Ui) f]Uj^y There exists also n 2 > 
such that h~ n2 (Vi) meets one of its translates Vj( 2 ) C Ui 2 . Let V 2 = h~ n2 (V\) f] Vj( 2 y 
Continuing in that way we find a sequence Vi, V 2 , . . . of non empty sets each Vi being 
contained in some Uj^y 1 < < k. We must have = for some i and i' , 

i < i'. Then, since Vi> C h~ p (Vi) for p = 77,1+1 + . . . + rii>, we have Uj^>) f] h~ p (Uj^) ^ 
contradicting the freeness of Uj^y 

2. Compactly connected components 

In this paragraph we consider any Brouwer homeomorphism h and an associated 
oriented Brouwer line / such that W = Hn^oo B n an d W = fln^oo B' n have no interior 
(where as above B n (resp. B' n ) is the component of R 2 \ h n {l) to the right (resp. to the 
loft) of //"(/)). 

Notice that the sets W and W are disjoints, that the invariant set O = R 2 \ (W \J W) 
is homeomorphic to R 2 and that on this set h is conjugate to a translation. Similar 
considerations can be applied to each one of W and W and we will only describe those 
pertaining to W. 

The set W is generally not connected. It is also non-compact (since it is invariant 
and points are wandering under h) and we will have to consider its compactly connected 
components. Let us recall (see [Moore, page 76] and also [LR2, Definition 9.1]) 

2.1 Definition. A space Z is compactly connected if any two points in Z are contained 
in a subcontinuum of Z. Distinct maximal compactly connected subsets of a space X are 
disjoint and are called the compactly connected components of X; these components fill 
in X . Notice that these compactly connected components can be non closed. 

2.2 Lemma. The compactly connected components ofW are unbounded. 

Proof: We work in the Alexandroff compactification of R 2 , that is R 2 U{°°} — $ 2 - 
First, VF|J{oo} is compact and connected as the decreasing intersection of the compact 
connected £? n lJ{oo}. Suppose now that W admits a compactly connected component C 
contained in some open ball B(0, R). Then C is connected and compact so is a connected 
compact component of W. As such, it is the intersection of the open and closed subsets 
of W which contains C [B, II §4.4], and there exists an open and closed neighborhood of 
C inside W P| B{0, R). But this contradicts the connectivity of VF|J{oo}. 

Let us call C a closed compactly connected component of W and p an accessible 
point of C from R 2 \ C : p is the extremity of an arc 7 such that 7 \ {p} C R 2 \ C. We 
can suppose that 7 is a free simple arc. Each h n {l) has to meet 7 and ^(7) for n larger 
than some no which we can suppose to be —1, replacing / by h n ° +1 (l) if necessary. Let p n 
denote the last point of h n (l) on 7 as we move towards p. Then the arc 7 n = p n p on 7 is 
disjoint from all h l (l),i < n except for p n e h n (l). 

Let qo = h(p-i) and «o be the subarc poqo of /. Since R 2 \ (W(JW) is simply 
connected (even homeomorphic to R 2 ), it is divided by the arc 

7o U a o U M7-i) m t° two domains and we call O the one which does not contain /i -1 (Z). 
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2.3 Proposition. The domain is free. 

Proof. Suppose there exist x E Q(~)h(Q) and let (3 be an arc from a to h~ 1 (x) with 
a E intpop and (3 \ {a} C O. Since h preserves orientation, h(y) O for y close to 
a on (3. As f] h(pop) = h(a) and h((3)f]ao = (since /i(/3) is on the right of of 
h(l) and so, on the right of / which contains ao), there exist some b E (3 such that the 
subarc h(ab) of h{(3) joins h(pop) to pop inside R 2 \ (VF|J W|J0) and the Jordan curve 
«o U Qoh(a) U h(ab) [j h(b)po contains the whole Brouwer line / or C (according to po or p 
is contained inside that Jordan curve) which is absurd since these sets are unbounded. 

2.4 Proposition. The closed compactly connected component C cannot be h-invariant. 

Proof: Assume by contradiction that h(C) = C and let then K C C be a continuum 
containing p and h(p). Then O is bounded and being simply connected has a boundary FrO 
which is connected and separating the plane. We first show K = O f] K is compact and 
connected. It is enough to show that FrO f\ C is connected for then, if K = (FrO f\ C) f] K 
is not connected then (FrO P) C) (J K C C separates the plane which contradicts the fact 
that C has no interior and does not separate. Let us note 5 = 70 U a o U ^(7-i) so that 
FrO P| C = FrO \(S\ {p, h(p)}. If this last set is not connected, it has either three compo- 
nents or more, and then FrO is not connected or two components, containing p and h(p) 
respectively, which do not disconnect the plane and then FrO does not disconnect. 

Therefore E = \J neZ h n (K) C W is a closed connected set which is invariant under 
h and therefore non compact. As W does not separate R 2 and has no interior, the same 
is true of E and R 2 \ E is homeomorphic to R 2 . The proper line / separates R 2 \ E into 
two regions homeomorphic to R 2 and we name R the one between / and E. The region R 
itself is cut by the arc pop into two regions A and B where we call A the one containing 
O and B the one containing /i _1 (0) f]R. By definition pop is on the frontier of A and B. 
Notice that A (and B) are non compact since we can follow / to infinity in one direction 
or the other staying in A (or B). Note that A contains /i fc (0),/c > and B contains 
h~ k (9) f]R,k > 1. 

2.5 Lemma. FrAf]FrBf] E is non compact. 

Proof. Let E^ (resp. E_g) be the set of points of E which admit a neighborhood 
contained in A|JE (resp. S|JE). The sets A|JE^4 and SljE^ are disjoint and open, 
therefore their complement in R[J E |J \(pop\{p}) (which is the set of points of E for which 
every neighborhood meets A and B, that is FrAP|Fr£?P| E) separates R [j E\ (pop\{p}) and 
R (J Z\(p p\{p}) can be written as the disjoint union (A [j E A ) U( B U E s) U( FrA (1 FrB D s )- 

On the other hand, if FrAP|Fri?P| E was compact in R 2 or equivalently in R [J E 
(which is homeomorphic to R 2 ), thinking of / as a straight line and of pop as a segment 
orthogonal to / (as it is legitimate by Schoenflies theorem), one can find a large rectangle 
in R[j E with a side parallel to / , containing FrAP|Fr£?P| E and whose boundary cuts pop 
transversaly in a single point. The boundary of this rectangle joins a point of A near p Q p 
to a point of B near p Q p in contradiction to the above decomposition of R[j E\ (poP\{p})- 

Given Lemma 2.5, let us choose some point x in FrAP|Fr£?P|E and outside K. Then 
x O and we choose an open euclidean ball 2U C R [j E centered at x free and disjoint of 
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O. (U will denote the ball of radius one half the one of 2U). As x belongs to E, U meets 
some h m (K) and so some h m (Q) and (exchanging h and h~ x if necessary) we can suppose 
m > and therefore that h m (Q) C A. Since U meets B, we want to show that 2U meets 
some h~ n (Q), for some n > 0, for then 2U and fi will give a contradiction to Lemma 1.1. 

To that end, let us choose on FrU two arcs, one on FrU f] A and the other on Frll f] B 
(these exist since U meets A and B which are connected non compact) and choose an arc 
«o inside R\ (E (J U) joining these two arcs and meeting transversally pop into a single 
point. Complete cto by a sub-arc ol\ of FrU . This gives a Jordan curve a inside R |J E 
which contains p in its interior. Since points are wandering there exists N > such that 
h~ N (p) E E belongs to the exterior of a. 

Now, if U does not meet any h~ k (Vt),k > 0, the connected set K = \J^ =1 h~ l (K) 
either joins p inside a to h~ N (p) outside a without meeting a (in contradiction to the 
Jordan curve theorem, or it meets a\ (K, contained in E, does not meet cto) and then U 
meets some h~ l (K) C K and so 2U meets some h~ l (Q)) and we are done. This concludes 
the proof of Proposition 2.4. 

2.6 Corollary. h n (C) f| C = for all n G Z \ {0}. 

Proo/ If h n (C)f]C ^ then /i n (C) = C in contradiction to 2.4 applied to h n which 
has the same W as /i. 

Recall that given given a sequence {X n } of subspaces of a topological space Z, a point 
x E Z belongs to liminf X n if every neighborhood of x meets X n for an infinite number of 
n and to limsup X n if every neighborhood of x meets X n for all but a finite number of n. 

We will now suppose that X = liminf h n (C) is not empty. It is then a closed and non 
compact subset of W (since it is /j-invariant). We aim to Proposition 2.12 below. Our first 
step is : 

2.8. Proposition. The set X is also limsup h n (C). That is, every open set U which meets 
an infinite number of h n (C), meets h n (C) for all n greater than some n = n (U). 

Remark: This Proposition answers a question of F. Le Roux [LR2, footnote 7] 

Proof: We will use repeatedly the following immediate consequence of a result of Le 
Roux [LR2, Lemme 9.3], we repeat the proof here for completeness. 

2.9. Proposition. Xf)h n (C)=® for all n E Z. 

Proof: Since X is /i-invariant, it is enough to show that X f] C = 0. Let us suppose 
Xf]C ^ 0, and let U be a free neighborhood of x E X f]C such that Uf]h(C) = 0. 
As x E X, there exists n > 1 so that Uf]h n (C) ^ 0. Let y E C such that h n (y) E U. 
There exists a continuum K C C which contains x and y. Since h(C) (as C) is free, we 
can find a free connected neighborhood V of h(K) C h(C) such that U f]V = 0. But 
x E UP\h- x (V) and h n (y) E Ufth™- 1 ^) so that U and V contradict Lemma 1.1. 

Let V be a free open disc and D a component of V \ \J neZ h n (C). 



6 



2.10. Lemma. If FrD meets h n (C) and h m (C), then \n — m\ < 1 and FrD cannot meet 
X if it meets some h n (C). 

Proof. To prove the first assertion, note that since Xf]h n (C) = for all n, given 
x G h n (C) there exists a disc neighborhood U of x which does not meet any other h p (C) 
and a ray from x to some point in D f] U leads to an accessible point of h n (C) from D. 
So let us suppose \n — m\ > 1 and let a be an arc from a G h n (C) to b G h m {C) such 
that a \ {a, b} C -D and let K be a continuum in h n (C) containing a and h n ~ m (b). We 
assert that X [J a is free. Indeed, iiT is free as a subset of h n (C), a is free as V is free and 
h(K)f]a = = ^(.fOna since n ± 1 ^ m. But 6 G h m ~ n {K {J a) {J(K {J a), and a 
small enough neighborhood of K[Ja will contradict Lemma 1.1 if \n — m\ > 1. 

Let us suppose now that X meets YxD and some h n (C) and let again U be a disc 
neighborhood of some point x G FrDf]X small enough so that Uf]h k (C) = if \k\ < 
\n\ + 1. A ray issued from x will either give an accessible point of some /i m (C), |m| > |n| + 1 
from D, but this is impossible according to the first part of the proof, or an accessible point 
of X from D. In that case, let a be an arc from some point a G h n (C) to b G X with 
a \ {a, 6} C -D and let t/ 7 be a free neighborhood of 6 such that U'f]h k (C) = 0, for 
\k\ < \n\ + 1 and such that E/ 7 f| fr" (a) = 0. The arc ct can be extended to an arc 
a C a{jU which joins a G h n (C) to some 6 G /i m (C), |m| > |n| + 1. If K C /i n (C) 
is a continuum containing a and h n ~ m (b), then iiTlJa is a free continuum such that 
b G h m ~ n (K \Ja)f\K\Ja and a free neigborhood of this continuum gives a contradiction 
to Lemma 1.1. 

We now return to the proof of Proposition 2.8. Let V be a free neighborhood of 
x G liminf h n (C). There exist m and n > m + 1 such that V meets h n (C) and h m (C). Let 
a be an arc in V going from a m G h m (C) to a n G h n (C) disjoin t from h m (C ) and h m (C) 
except for its extremities. Let D be the the component of V \ Unez h n (C) which meets 
a and has a n on its frontier. By 2.11, FrD meets h n+1 (C) or /i n-1 (C). In the first case, 
let a n _|_i be the last point of h n+1 (C) seen on a when going from a n to a m . If D' is the 
component of V \ [J neZ h n {C) which meets the subarc a m a n +i of a and has a n +i on its 
frontier, then FrD' does not meet h n (C) by construction of a and therefore, according to 

2.10. meets h n+2 (C). Iterating this process we see that a meets all /i fc (C), k > n. In the 
other case, the same reasonning shows that a meets all the h k (C) for m < k < n. As a 
meets an infinite number of h k (C) we conclude in either case that V meets all h h (C) for 
k large enough and therefore x G limsup h n (C). 

2.11. Assumption: We assume for the rest of this paper that the compactly 
connected components of W (in fact, we will only consider those of X) are 
closed. 

2.12. Proposition. No point of X is accessible from R 2 \ \J neZ h n (C). 
Proof: We begin with a lemma : 

2.13. Lemma. There is no free arc a joining C to X contained in R 2 \ \J neZ h n (C) except 
for its extremities. 

Proof of 2. 13: Let a join p G C to q G X and consider a neighborhood D of q such that 
a[jD is still free and Df)h(C) = = Df^h^iC) (recall that X is disjoint from h(C) 
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and /i _1 (C) by proposition 2.9). Then a[jD contains a point h n (p') for some n > 1 and 
some p' G C. Let iiT C C be a continuum containing p and p' and consider the continuum 
L = K (J a (J D. It is free but h n (p') G h n (L) f] L and a small enough neighborhood of L 
gives a contradiction to Lemma 1.1. 

At this point we will finish the proof of 2.12 following the lines of the proof of a similar 
result (with C replaced by a disc) in [LR2, Proposition 5.5]. 

Let us suppose there exist a point q of X accessible from R 2 \ IJnez h n (C) by some 
arc a and let Z be the connected component of X which contains q. A point x of R 2 \ 
Unez h n (C) will be called a neighborhood point of Z if there exists a free closed euclidean 
disc D with center x such that int-D f] Z ^ 0. The set of all such points is an open set V 

A point of x G V will be said of type C if there is some euclidean disc D of center x 
as in the previous definition and an arc in D from x to Z which meets some h n (C) and of 
type Z if there exists such a disc D and an arc in D from i to Z which does not meet any 
h n (C). It follows from Lemma 2.13 that this type is well defined. 

We show that all points of V are of type C. Indeed, it is easily verified that the 
type is locally constant on V and so is constant on every connected component of V . But 

V |J Z and R 2 \ Z are connected and therefore their intersection V also as follows from the 
Mayer- Vietoris sequence of the pair (R 2 \ Z, V |J Z). Furthermore, since Z C X , certainly 

V meets some h n {C) and all points of V are of type C. 

Now, if the point x on the arc a is close enough to q, the subarc xq of a is con- 
tained in a free euclidean disc which meets Z, and, x being of type C, meets some h n (C). 
Contradiction. 
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